If real children are never involved in the process, what's the harm? Schoolgirl fantasies are extremely common in written fiction as well as drawn and live action pornography, despite the (fictional) subjects being underage. Should we police those, too? There's a clear line between generated fictitious content and actual victimization, and IMO AI Dungeon doesn't cross it. Obviously, they're under no obligation to intentionally host such content on their platform, but as has been demonstrated by the controversy it is quite difficult to actually police it in a way that both preserves user privacy and doesn't block similar but non-offensive content.

In December 2019, Utah startup Latitude launched a pioneering online game called AI Dungeon that demonstrated a new form of human-machine collaboration. The company used text-generation technology from artificial intelligence company OpenAI to create a choose-your-own adventure game inspired by Dungeons & Dragons. When a player typed out the action or dialog they wanted their character to perform, algorithms would craft the next phase of their personalized, unpredictable adventure. Last summer, OpenAI gave Latitude early access to a more powerful, commercial version of its technology. In marketing materials, OpenAI touted AI Dungeon as an example of the commercial and creative potential of writing algorithms.\